Noise-induced cooperative dynamics and its control in coupled neuron models 
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We investigate feedback control of the cooperative dynamics of two coupled neural oscillators that 
is induced merely by external noise. The interacting neurons are modelled as FitzHugh-Nagumo 
systems with parameter values at which no autonomous oscillations occur, and each unit is forced by 
its own source of random fluctuations. Application of delayed feedback to only one of two subsystems 
is shown to be able to change coherence and timescales of noise-induced oscillations either in the 
given subsystem, or globally. It is also able to induce or to suppress stochastic synchronization 
under certain conditions. 



I. INTRODUCTION 

Neural systems in manycases are characterized by os- 
cillatory behavior 0, Q 13 , which is often quite com- 
plicated Q|. It has been shown that neural oscillatory 
dynamics can have different origins, being either self- 
sustained or induced by random fluctuations alone 
0, Q. These oscillations can also be multimodal, i.e., 
consisting of several components with different promi- 
nent timescales. For example the thalamocortical relay 
neurons can generate either spindle or 5 oscillations |8|, 
whereas the electro-receptors in a paddle fish are able 
to generate biperiodic oscillations 9]. Coupled neurons 
are able to demonstrate synchronization, which plays a 
very important role in neurodynamics, having either con- 
structive, or destructive effects depending on the circum- 
stances. 

On one hand, the ensembles of different neurons can 
be synchronized in order to process biological informa- 
tion, i.e., this synchronization might be beneficial for a 
more efficient data transmission [H], |nj . On the other 
hand, these synchronized neurons can induce a regular, 
rhythmic activity, which is believed to play a crucial role 
in the emergence of pathological rhythmic brain activ- 
ity in Parkinson's disease, essential tremor, and epilepsy 
Il3j|. In both situations, synchronization phenomena 
occur spontaneously, and the mechanisms behind them 
are the subjects of intensive research 0, [^. Hence, 
the development of techniques that would allow one to 
manipulate the neural synchrony is an important clinical 
problem. 

Starting with the work of Ott, Grebogi and Yorke [l4| . 
a variety of methods for the control of irregular behavior 
have been developed in the last 15 years 0, H^ |. Re- 
cently, a number of methods have been proposed for sup- 
pression of synchrony in the arrays of coupled oscillators 
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in which oscillations are self-sustained 0,^3- However, 
the problem of control of the dynamics in coupled sys- 
tems where oscillations are induced merely by random 
fluctuations is still open. 

In this paper we investigate the possibility of us- 
ing for this purpose the delayed feedback scheme intro- 
duced by Pyragas [19| : it constructs a control force from 
the difference between the current state of the system 
and its state some r time units ago. This method is 
known as time-delay auto synchronization (TDAS). It has 
been applied to control of deterministic chaos in a wide 
ran ge o f svstems including spatially extended models, e.g. 

l2ll 221. It was also demonstrated that it can be 
used to control the coherence and the timescales of noise- 
induced oscillations in a single system 0, 0) HI] ■ This 
theoretical prediction has recently been verified experi- 
mentally in an electrochemical oscillator system [2(| . The 
main aim of the present work is to extend time-delayed 
feedback control of noise- induced dynamics to coupled ex- 
citable systems, and investigate if local control applied to 
a subsystem can allow one to steer the global cooperative 
dynamics in a system of coupled neural oscillators. In 
particular, we are interested in the study of the effects of 
delayed feedback on the synchrony properties in coupled 
neuron systems. 

The paper is organized as follows. In Section [H] we 
introduce the model system used, and discuss the prop- 
erties of their cooperative behavior without control. In 
Section IrTTl we study the effects of local delayed feedback 
control on the global behavior of coupled systems. In Sec- 
tion IIVI the results are summarized and the conclusions 
are drawn. 



II. GLOBAL DYNAMICS OF TWO COUPLED 
NEURAL OSCILLATORS 

In order to grasp the complicated interaction between 
billions of neurons in large neural networks, those are 
often lumped into groups of neural populations each of 
which can be represented as an effective excitable el- 
ement that is mutually coupled to the other elements 
[rH Il8[ . In this sense the simplest model which may re- 
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veal features of interacting neurons consists of two cou- 
pled neural oscillators. Each of these will be represented 
by a simplified FitzHugh-Nagumo system, which is of- 
ten used as a paradigmatic generic model for neurons, 
or more generally, excitable systems 27] . Here we use 
two FitzHugh-Nagumo systems with substantially differ- 
ent intrinsic timescales, and parameters corresponding to 
the excitable regime. Before attempting to control their 
global dynamics with locally applied feedback, we will 
first study the dynamics of the uncontrolled coupled sys- 
tem. The dynamical equations are given by: 



Vi 

£2 X2 

in 



X\ — - yi + C (x 2 - X\) 



X\ 



X2 - -g" - J/2 + C (xi - X 2 ) 



X2 



■DMt), 



(1) 



(2) 



where subsystems Eqs. Q and represent two differ- 
ent neurons, Xi (i — 1,2) describing the transmembrane 
voltages and yi modelling the behavior of several phys- 
ical quantities related to electrical conductances of the 
relevant ion currents across the respective membranes. 
Here a is a bifurcation parameter whose value defines 
whether the system is excitable or demonstrates periodic 
firing (autonomous oscillations), t\ and £2 are positive 
parameters that are usually chosen to be much smaller 
than unity, £1 and £2 are independent sources of Gaus- 
sian white noise with zero mean and unity variance, D\ 
and D2 are noise intensities. 

The synaptic coupling between two neurons is mod- 
elled as a diffusive coupling considered for simplicity to 
be symmetric j^, |2i3] • The coupling strength C sum- 
marizes how information is distributed between neurons. 

We shall restrict our analysis to the range of the pa- 
rameter values where without noise each of the two sub- 
systems exhibits excitability with only one attractor in 
the form of a stable fixed point. Noise sources £1 and 
£2 model random inputs that represent integral signals 
coming from the part of the neural network or of the en- 
vironment with which the neuron is connected. Since the 
neurons can be coupled to different parts of the neural 
network or of the environment, the noise intensities in 
the two systems can be quite different. 



A. Features of a single neuron model 

Let us illustrate the dynamics of a single neuron model 
by considering an uncoupled subsystem Eqs. (C=0) 
under the influence of noise. We arbitrarily fix £>i=0.02, 
and also set a = 1.05, ei=0.005. In Fig. ^a) dashed lines 
show the null-clines of Eq. Q that intersect at a fixed 
point marked by a white circle. The phase point that is 
initially placed at the fixed point stays in its close vicinity 
if the applied random perturbation remains small. How- 
ever, if the perturbation is larger than some threshold 



?C 



1 
\ 






1 

1 








1 , ^ 

1 ^ ^\ 

1 / \ 






1 / \ 






1 / 






| / 






1 / 






I 1 






1 






1 






/ 






\ 1 / 






\ 1 / — 








\ 






1 


1 


li 1 1 


\\ 


-2 


-1 1 


2 



(a) 




FIG. 1: (color online) (a) Phase portrait and (b) realizations 
of xi (grey, green online) and yi (black) time series in a single 
FitzHugh-Nagumo system Eq. Q. In (a) dashed lines are 
null-clines and the fixed point is shown by a white circle. 
Parameters: o=1.05, ei=0.005, D x = 0.02. 



value, the phase point makes a large excursion in the 
phase space before returning to the vicinity of the fixed 
point again. In Fig. IHa) the black solid line illustrates 
a phase portrait and in Fig. ^b) realizations of X\ and 
y\ time series from Eqs. Q are shown. The motion 
of the phase point consists of two stages: an activation 
time during which the system waits for a sufficiently large 
perturbation before it can make an excursion, and the ex- 
cursion itself. The excursion time is almost completely 
defined by the deterministic properties of the system and 
is hardly influenced by noise. 

On the contrary, the activation time is completely de- 
termined by the properties of noise if all other parameters 
are fixed: the stronger the noise, the smaller the activa- 
tion time and the larger the mean frequency of noise- 
induced oscillations is. Thus, the noise strengths D\ and 
D2 control the average frequencies of noise-induced oscil- 
lations in the systems Eqs. and respectively, and 
the difference between them defines the mean frequency 
detuning between the systems. 



B. Means for characterizing cooperative dynamics 

Before studying the effects of delayed feedback control 
on the model Eqs. JIJ and (2), let us examine the basic 
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features of cooperative dynamics of two systems in which 
oscillations are induced merely by noise. 

The cooperative dynamics of a system of coupled 
stochastic oscillators can be characterized differently de- 
pending on the feature of interest. The most popular 
features are timescales involved, degree of order in each 
partial subsystem and in the system of coupled oscillators 
as a whole, and the degree of synchronism between the 
subsystems. To quantitatively characterize each feature 
of interest, a number of criteria can be used, and here we 
will choose those that seem to suit best our purposes. 

Timescales. The Fourier power spectral density, to 
which in the following we will refer as spectrum for 
brevity, seems to be the most universal and sensitive tool 
that allows one to fully reveal the frequency content of 
random oscillations and thus characterize the timescales 
involved. The central frequencies of the highest spectral 
peaks will characterize the timescales involved. 

Another convenient and less computationally expen- 
sive way to characterize the timescales of oscillations is 
to introduce the interspike intervals (ISI) T\ and T 2 for 
the two systems from their realizations x\(t) and x% (£), 
respectively, as shown in Fig. 1(b). The average ISIs 
(Tj), i = 1, 2, will also characterize the timescales of two 
systems. 

Coherence. Generally, the width of the spectral peak 
can serve as an indication of the coherence of the oscilla- 
tions: the narrower the peak is, the more coherent the os- 
cillations are. However, as we will see below, the spectra 
of the observed oscillations have several distinguishable 
peaks with comparable heights placed at incommensu- 
rate frequencies (i.e., at frequencies that are not multi- 
ples of each other), and all peaks have different widths. 
It is not obvious the width of which peak should be taken 
as a measure of coherence, and thus the peak width does 
not represent an unambiguous criterion here and will not 
be used. 

Another measure of coherence of oscillations is the cor- 
relation time t cor . It is also not unambiguous because it 
can be introduced in several ways. Here we will use the 
following method which seems the most universal: an au- 
tocorrelation function ^f(s) = ([x(t — s) — (x)][x(t) — (x)]) 
will be calculated from the simulated realizations x(t), 
and t cor will be introduced as 

1 f°° 

tcor = -j / *(s) \da, (3) 
® Jo 

where a 2 = \l/(0) is the variance of x(t). The larger t cor 
is, the more regular x(t) is. 

Timescales and coherence can be introduced for each 
subsystem separately and then compared, or for some 
variable characterizing the state of the system as a whole. 
Thus, we will estimate the statistical characteristics of 
the variables X\ and x^, and of the global state variable 

XT, = X\ + X 2 - 

Synchronization. Finally, we need to characterize 
the synchronization between the two coupled oscillators. 
Most generally, synchronization means an adjustment of 



timescales of oscillations in systems due to the interac- 
tion between them: if the timescales in the uncoupled 
systems are not rationally related, introduction of cou- 
pling can shift the timescales to make their ratio closer 
to a rational number n:m, where n and m are integers. 
This phenomenon is usually referred to as n:m frequency 
synchronization, and its suitable measure would be the 
closeness of the ratio of average ISIs (Ti)/ (T 2 ) to the cho- 
sen rational number 77:777. Note that frequency synchro- 
nization is associated with the time-averaged behavior of 
the coupled oscillators. 

A closely related, but not identical, phenomenon, 
which is usually called phase synchronization, is asso- 
ciated with instantaneous coordination between the in- 
teracting systems. It requires the definition of phases 
y>i(t) and <f2(t) for each oscillator and comparison be- 
tween them. In our system the spiky nature of oscilla- 
tions allows one to introduce the phase for each system 
as: 

¥>,•(*) = 27r *~*f~ 1 + 2tt(« - 1), .7 = 1,2,..., (4) 

where t% is the time at which we observe a spike in the 
respective system's realization. 

We define n:m phase synchronization to occur if the 
phase difference 

777 

A</5 n>m (t) = <pi(t) V2{t), (5) 

77 

exhibits horizontal plateaus of sufficient duration. Usu- 
ally, if 77:777 synchronization takes place, Atp n/m (t) 
demonstrates plateaus occasionally interrupted by 2ir 
jumps. On the plateaus, A(p ntTn (t) usually oscillates 
around some local average level. As time grows, 
Aipn.m(t) drifts to plus or minus infinity. 

In |3l| several measures to characterize phase synchro- 
nization were introduced. Here, we choose to estimate 
the synchronization index 



ln, m = y (cos A^„, m (i)} 2 + (sin Aip, hm (t)) 2 . (6) 

In.m can vary between (no synchronization) and 1 (per- 
fect 77:777 phase synchronization). Note that even if the 
ratio of average ISIs is close or even equal to some ra- 
tional number n:m, i.e., frequency synchronization takes 
place, phase synchronization does not necessarily occur, 
and the synchronization index might be close to zero. 

C. Cooperative noise-induced dynamics in two 
coupled neurons: timescales and coherence 

All results in this paper are presented for a=1.05, 
ei=0.005, e 2 =0.1, and D 2 = 0.09. Mean frequency de- 
tuning will be determined by the choice of D\. Note 
that £1 ^ £2, i.e. the systems are not identical, therefore 
at D± = D 2 the mean frequencies of oscillations in two 
uncoupled (C = 0) systems will be different. 
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FIG. 2: (color online) Realizations of ii (lower), 12 (middle) 
and ie = ii + £2 (upper trace) of noise-induced oscillations 
in two coupled FitzHugh-Nagumo systems Eqs. l(T)l. J2J for 
various noise intensities Z?i in the first system for C—0.07. 



We need to find out how the cooperative dynamics of 
the interacting systems changes depending on coupling 
strength C and on the mean frequency detuning defined 
by£>i. 

We first fix the coupling strength C at 0.07, and change 
D\. Fig. EJshows the realizations x\, X2 and xy, of noise- 
induced oscillations. At D\—Q the first subsystem, whose 
variables are denoted by subscript 1 in Eq. has no 
independent dynamics. But due to the coupling with 
the second subsystem, it demonstrates forced oscillations 
whose properties are completely defined by those of the 
second subsystem. The respective realizations of x\ and 
X2 demonstrate excellent synchrony, so that each spike in 
X2 causes a spike in x\ that occurs simultaneously (Fig. 
□ (Di=0)). 

At D\ ^ the first subsystem acquires its own dy- 
namics with the respective independent timescale. Now 
each time one of the subsystems produces a noise- induced 
spike, due to coupling the other subsystem is prompted 
to spike, too: it does not necessarily emit a spike, but the 
spiking probability grows slightly. As a result, both sub- 
systems are likely to spike slightly more frequently (Fig. 
[21 (Z?i=0.05)) This is reflected by the decrease of respec- 
tive average ISIs in Fig. Eta). As D\ grows further, the 
mean frequency of spiking in the first subsystem grows in 
agreement with [3^]. However, coupling is small here, so 
the second subsystem only rarely responds with a spike 
to the spike in the first subsystem. As a result, while 
the spiking frequency in the first subsystem is further in- 
creased, the second subsystem's frequency stays almost 
constant (Fig. (D x =l) andEJa)). 

The continuous change of timescales and of coherence 
of the noise-induced dynamics with D\ is illustrated in 
Fig-EJ Here, average ISIs (a) and t cor (b) are shown. The 




FIG. 3: Timescales and coherence of noise-induced oscilla- 
tions in two coupled FitzHugh-Nagumo systems Eqs. Q and 
© vs Di at C=0.07. (a) Average ISIs (Ti) (solid line), (T 2 > 
(dashed line) and their ratio (circles), (b) Correlation time 
t cor obtained from xi (solid line), X2 (dashed line) and xs 
(circles). See text for details. 



latter are estimated from x\ and X2 thus quantifying the 
local dynamics, and from x^=xi+X2 thus characterizing 
the global behavior. 

All three graphs for t cor show clear maxima which can 
be regarded as occurrence of coherence resonance (CR) 
[3^| . However, in different systems CR occurs at different 
noise intensities D±, and the mutual coupling between 
the two systems leads to the occurrence of two maxima 
in t cor calculated from X2- 

Now consider how noise-induced dynamics changes 
with variation of the coupling C between neurons. We 
choose Z?i=0.25, so that without coupling (C=0) the os- 
cillations in the two systems have essentially different 
timescales with (Ti) « 3.25 and (T 2 ) « 8.1. At C=0 
the two subsystems oscillate independently (Fig. 0] top 
panel). As the coupling is increased from zero, the sub- 
systems start to experience each others' influence: each 
time one system spikes, the other is prompted to spike, 
too (Fig. EJ middle panel). This results in timescales 
moving closer (Fig. yfa)). As the coupling grows further, 
the two subsystems spike more simultaneously (Fig. 
bottom panel), and their average ISIs tend to coincide. 
The latter can serve as an evidence for stochastic 1:1 fre- 
quency synchronization |34| . which will be discussed in 
more detail below. 

The full dependence of ISIs and t cor on C is shown in 
Fig. El In the absence of coupling, the two systems ran- 
domly oscillate, being independent of each other, hence 
the coherence of the sum signal is less than the coher- 
ences of the individual signals. At large C > 0.2, the 
global coherence becomes equal to the coherence of the 
second system, which is more ordered individually than 
its neighbour. 
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FIG. 4: (color online) Realizations of xi (lower), X2 (middle) 
and xt, (upper trace) of noise-induced oscillations in two cou- 
pled FitzHugh-Nagumo systems Eqs. and JS) for various 
coupling strengths C at Di=0.25. 
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FIG. 5: Timescales and coherence of noise-induced oscilla- 
tions in two coupled FitzHugh-Nagumo systems Eqs. Q and 
© us coupling strength C at Di=0.25. (a) Average ISIs (Ti) 
(solid line), (T2) (dashed line) and their ratio (circles), (b) 
Correlation time t cor obtained from x\ (solid line), X2 (dashed 
line) and xs (circles). See text for details. 



D. Synchronization: frequency (phase) locking and 
suppression of noise-induced oscillations 

Synchronization phenomena in coupled oscillators with 
noise-induced dynamics were previously considered, e.g. 
in 0,|33. In contrast to these works, our model consists 
of essentially non-identical subsystems whose dynamics 
is defined by independent sources of noise with different 
strength, which describes a more general class of natural 
systems. 
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FIG. 6: (color online) (a) Ratio of average interspike inter- 
vals (Ti) / {T2) from the two systems, and (b) synchronization 
index 71,1 vs the coupling strength C and noise intensity D\. 
The light (yellow) areas roughly outline the 1:1 (a) frequency 
and (b) phase synchronization tongues. 



In this paper we will discuss only 1:1 synchronization. 
Since synchronization means an adjustment of timescales 
in interacting systems, the ratio of their average ISIs 
would serve as a good tool for its detection. In Fig. EI a) 
the ratio (Ti)/(T 2 ) is shown for a range of coupling 
strengths C and of noise intensities D\ . One can clearly 
see the 1 : 1 synchronization region (light area) , which has 
a quite recognizable tongue- like shape, i.e., the larger the 
coupling strength, the wider the synchronization region 
with respect to D\ is. 

Next, we explore if phase synchronization accompanies 
the frequency synchronization. In Fig. the phase differ- 
ence is shown for Di=0.25: as C is increased from 0.1 to 
0.4, the plateaus of A(p n , m (t) become longer. At C = 0.4 
the coupling is so strong that the plateau exists (almost) 
infinitely, which means that the two systems are well 1:1 
phase synchronized. 

The synchronization index 71.1 is computed in the 
whole range of D\ and C and is shown in Fig. Efb). 
Inside the whole region of 1:1 frequency synchronization 
where the ISI ratio is close to unity, the phase synchro- 
nization index is close to unity, too. Thus, phase synchro- 
nization occurs together with frequency synchronization. 

It has been known for a long time that synchroniza- 
tion can be achieved via at least two different mecha- 
nisms, namely frequency (phase) locking, and suppres- 
sion of natural dynamics, respectively (see |36| for peri- 
odic oscillations and [37j for chaotic and noise-induced 
oscillations). We found that in our model both these 
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FIG. 7: Phase difference Ay>i,i for the suspected 1:1 syn- 
chronization at three different values of coupling strength C 
and £>i=0.25. 



synchronization mechanisms can be realised, depending 
on how well the timescales of interacting oscillators were 
separated from each other when uncoupled. An exam- 
ple of synchronization via frequency (phase) locking is 
illustrated by Fig. Eta), where for £>i=0.25 the spectra 
of signal X\ and of xi are illustrated for increasing C. 
As C grows, two distinguishable peaks corresponding to 
the timescales of the two subsystems move closer and 
then merge. Fig. (5Tb) shows how synchronization is re- 
alised via the suppression of natural dynamics at Di=0.5. 
One can see that the increase of C suppresses one of the 
spectral peaks, i.e. one of the timescales of the system 
Q). Thus, mutually coupled systems with noise-induced 
spiking are able not only to demonstrate mutual syn- 
chronization itself, but also to reproduce two different 
synchronization mechanisms, in full analogy with cou- 
pled self-oscillating systems. 



III. LOCAL DELAYED FEEDBACK CONTROL 
OF NOISE-INDUCED COOPERATIVE 
DYNAMICS 
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FIG. 8: (Color online) The spectra of x\ (black) and X2 
(shaded grey area, green online) are compared as the cou- 
pling strength C is increased for two different strengths of 
noise in the first subsystem (a) Di=0.25 and (b) Di=0.5. In 
(a) the highest spectral peaks move towards each other and 
coincide: frequency (phase) locking. In (b) the highest peak 
in the spectrum of x\ is suppressed, while another peak si- 
multaneously appears and grows at the peak frequency of X2- 
suppresion of natural dynamics. 



In this section we investigate whether the feedback ap- 
plied only to one of the interacting subsystems, i.e., lo- 
cally, is able to manipulate the global properties of the 
system of coupled oscillators. This might simulate a re- 
alistic situation where only a small area of the neural 
network is available for external stimulation. In particu- 
lar, we will investigate if global timescales, coherence and 
the strength of synchronization can be influenced. 

The time-delayed feedback control proposed by Pyra- 
gas for control of deterministic chaos was previously 
applied for the control of noise-induced oscillations in a 
single system with noise-induced dynamics |23L l24l |25| . 
It has been demonstrated that it can successfully change 
the timescales and coherence of oscillations and is thus 
a promising tool for control of noise-induced phenomena 
in general. 

For our purpose, we apply the time-delayed feedback 
to the first subsystem alone, while the second system 
remains freely coupled to it. The feedback force F{t) is 
constructed as follows: the slow state variable y\ is saved 



at the current time t and at a time (t — r), their difference 
is calculated and multipled by the feedback strength K . 
F(t) is then fed back to the y-component of the vector 
field 

ei ±i = x x --±-y x +C {x 2 - xi) , (7) 

yi = x 1 +a + K\jj 1 (t-T)-y 1 (t)] + Dit(t), 

where r is the time delay and the other parameters are 
as in Eqs. 

We will be guided by the full picture of cooperative dy- 
namics of the two mutually coupled subsystems that was 
revealed in Sec. |n] We will choose states with different 
global dynamics by choosing pairs of parameters D\ and 
C, and study the effect of the delayed feedback on each 
state. 

We select pairs of points (Di, C) (see Fig.01 at which 
the two systems are (i) far away from (D^O.6, C=0.1), 
(ii) closer to (Di=0.6, C=0.2), and (hi) almost inside 
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(.Di=0.15, C—0.2) the 1:1 synchronization region. In 
Sec. 1111 Al we study in detail the case of a moderately 
synchronized system at Z?i=0.6 and C=0.2, subject to 
delayed feedback. We reveal the common features of the 
feedback effect depending on its parameters r and K. 
Further on, 



in Sec. IIII Bl we study two more cases 
of systems further from, and closer to, the 1:1 synchro- 
nization region under the delayed feedback action. We 
compare the effect of the feedback with its effect on a 
moderately synchronized system. 



A. Control of a moderately synchronized system 

Here, we consider subsystems Eqs. (J7J) and (0) with 
Z?i=0.6 and C=0.2, under the influence of the controlling 
feedback. We aim to find out if the feedback can make the 
subsystems more, or less, synchronous, and their global 
dynamics more or less coherent. In particular, we are in- 
terested if perfect 1:1 synchronization can be induced by 
the local feedback, or if the existing synchronization can 
be destroyed. The ratio of ISIs and the synchronization 
index 7^1 are shown by color code in Fig. El for a large 
range of the values of the feedback delay r and strength 
K . The lighter areas are associated with the stronger 1:1 
synchronization, and the values at K=0 and at r=0 char- 
acterize the original state of the system without feedback. 
As seen from Fig. the locally applied delayed feedback 
is able to move the system's state closer to the 1:1 syn- 
chronization with suitable feedback parameters. On the 
other hand, for r « 2.5 (black area) 1:1 synchronization 
is suppressed. 

An illustration of how realizations x\, xi and x^ 
change depending on the feedback strength K as r=l is 
fixed, is given in Fig. ^| Note that the cut at r=l (Fig. 
9) goes through the region where the strongest 1:1 syn- 
chronization is achieved. As K grows, the oscillations in 
the two subsystems become more and more synchronized 
until at K=2 the two systems start to fire simultaneously 
almost all the time. However, at least in the given range 
of K, the perfect 1:1 synchronization, with both ISI ra- 
tio and synchronization index equal to unity, is still not 
realized. 

Fig. Illf a) shows the full dependences upon K of (Ti) 
(solid line), (T2) (dashed line) and of their ratio (circles). 
In Fig. II If b') the respective dependences of correlation 
time t cor from x\ (solid line), (dashed line) and from 
the sum signal (circles), are given together with the 
synchronization index 71^ (grey line, green online) . Both 
(Ti) and (T2) grow monotonically with K, which means 
that at r=l the feedback slows down the oscillations. 
Within the accuracy of numerical simulation, both ISI 
ratio and 71,1 grow linearly with K, still not achieving 
the value of 1 at K=2. t cor from x-% grows with K almost 
linearly as well, which means that the global dynamics of 
the system becomes more ordered with the stronger feed- 
back. However, t cor computed from x\ and xi separately 
are nonmonotonic. 
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FIG. 9: (color online) Effect of delayed feedback on fre- 
quency and phase synchronization betwen the two subsystems 
at Di=0.6 and C=0.2, which corresponds to a moderate dis- 
tance from the 1:1 synchronization tongue shown in Fig. |H| 
(a) Ratio of average interspike intervals (T\) / (T2) from the 
two systems and (b) synchronization index 71,1 vs the control 
strength K and the time-delay r. 
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FIG. 10: (color online) Realizations of xi (lower), xi (middle) 
and xt, (upper trace) of noise-induced oscillations in two cou- 
pled FitzHugh-Nagumo systems Eqs. Q and @ at Z?i=0.6 
and C=0.2, subject to delayed feedback with r = 1 for dif- 
ferent values of the feedback strength K. See Fig. 1111 for 
reference. 




FIG. 11: (color online) Timescales, coherence and synchro- 
nization index of noise-induced oscillations in two coupled 
FitzHugh-Nagumo systems Eqs. JJJ and (0 vs K of the local 
feedback at r = 1, T>i=0.6 and C=0.2 (see Fig. for ref- 
erence), (a) Average ISIs (Ti) (solid line) and (Tb) (dashed 
line), and their ratio (circles), (b) Correlation times t cor ob- 
tained from xi (solid line), from xi (dashed line), and from xy. 
(circles). Synchronization index 71,1 (grey line, green online). 



Next, we follow the route with a constant K=1.5 that 
crosses the area with the strongest synchronization, by 
changing r. Four respective realizations from the sub- 
systems are shown in Fig. ^| A full picture showing 
ISIs, their ratio, correlation times and synchronization 
index vs r is given in Fig. ^31 Both (Ti) and (T2), as well 
as their ratio, change nonmonotonically with r while its 
value is smaller than 8. At r > 8 they start to asymp- 
totically tend to some constant values that are slightly 
larger than those without feedback. 

An increase of r from zero leads to an increase of both 
(Ti) and (T 2 ). But (Ti) grows faster than (T 2 ), thus their 
ratio (Ti)/(T 2 ) grows with r, as well as the phase syn- 
chronization index 71,1. At the same time, the coherence 
of each subsystem and of their global dynamics grows, 
too, as illustrated by the behavior of the respective cor- 
relation times t cor (Fig. HHT b)). 

After the maximum of (Ti) and (T 2 ), and of their ratio, 
is achieved at t~0.7, both (Ti) and (T2) start to decrease, 
but again (Ti) decreases faster than (T 2 ), thus their ratio 
decreases. A similar behavior is observed in t cor and in 
7i,i- 

Starting from r«2, the ISI (Ti) of the first system 
hardly changes with r. However, counterintuitively, the 
ISI (T 2 ) of the second system responds to the further 
increase of r by displaying a noticeable maximum at 
r«2.5. This leads to a well-pronounced minimum of 
the ISI ratio (Fig. EH a )) an d of the synchronization in- 
dex 7^1 (Fig. IliSf bD. This phenomenon is accompanied 
by a respective maximum of the coherence of the sec- 
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FIG. 12: (color online) Realizations of xi (lower), X2 (middle) 
and xt, (upper trace) of noise-induced oscillations in two cou- 
pled FitzHugh-Nagumo systems Eqs. JjJ and J2) at Z?i=0.6 
and C=0.2, subject to delayed feedback with 7^=1.5 for dif- 
ferent values of the time delay r. See Fig. I13l for reference. 



ond susbystem and of the global dynamics, while neither 
the timescales nor the coherence of the first subsystem 
change substantially. This is a highly counterintuitive 
phenomenon, since the feedback is applied to the first 
subsystem only, while the second subsystem responds to 
the changes of the feedback only indirectly through its 
coupling with the first subsystem. 

With the further increase of t, the dynamics of the sec- 
ond subsystem changes more substantially than the one 
of the first subsystem, and thus gives a larger contribu- 
tion to the changes of the global dynamics. 



B. Control of a weakly, and of a strongly, 
synchronized system 

In this subsection we consider subsystems Eqs. (JJJ 
and J2J that are either further from (T>i=0.6, C=0.1), 
or closer to (T>i=0.15, C=0.2), the 1:1 synchronization 
region, under the influence of the controlling feedback. 

For Di=0.6, C—0.1, the ratio of ISIs and the synchro- 
nization index 7^1 are shown by color code in Figs. 1141 
As with the stronger synchronized subsystems, the feed- 
back is able to move the whole system towards a more 
synchronous state. 

As with the example of Sec. lIII A1 we consider the cut 
of the t-K plane along K = 1.5, choosing the route 
that goes through the lighter area of the largest synchro- 
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FIG. 13: Timescales, coherence and synchronization index of 
noise-induced oscillations in two coupled FitzHugh-Nagumo 
systems Eqs. J7J and @ vs time delay r at K — 1.5, Di=0.6 
and C=0.2 (see Fig. |^j for reference). Symbols as in Fig. 1111 

nization index. ISIs, their ratio, correlation times, and 
synchronization index are shown in Fig. 1151 depending 
on r. Their behavior has some similarities to that in a 
moderately synchronized system of Sec. IIII Al 

Namely, the initial increase of r from zero leads to 
the growth of both (Ti) and (T2), the former growing 
faster than the latter. This leads to the growth of the 
ISI ratio and of synchronization index 71,1, and also of 
t cor of xi and of All variables achieve the maxi- 
mum at rwO.6. After that, all the variables describing 
the first system start to decrease, while (T2) does not 
change until r=1.5. Here, the ISI ratio decreases corre- 
spondingly, like for C=0.2. And again, after r=2, (Ti) 
hardly changes with r, while {T2) exhibits a noticeable 
maximum that leads to the rapid drop of both ISI ratio 
and synchronization index. 

With further increase of r beyond 6, both subsystems 
respond only slightly and comparably to the changes in 
r. 

Note that either for a moderately synchronized system, 
or for a system that is less synchronized, the feedback is 
able to make 1:1 synchronization substantially stronger 
for a suitable choice of its parameters. However, it cannot 
destroy the existing synchronization or weaken it as much 
as it can strengthen it. 

For the system that is very well synchronized from the 
beginning at Di=0.15 and C=0.2 with 7i,i=0. 99, we re- 
veal the ISI ratio and synchronization index 7^1 for a 
large range of K and r (Fig. I16|) . Already this picture 
shows that delayed feedback can either enhance or sup- 
press synchronization. 

For a more detailed picture of the phenomena induced 
by the feedback, a cut of this picture along K=l is given 
in Fig. 1171 where the ISIs and their ratio are shown, to- 




FIG. 14: (color online) Effect of delayed feedback on fre- 
quency and phase synchronization betwen the two subsystems 
at Di=0.6 and C=0.1, which are further away from the 1:1 
synchronization tongue shown in Fig.|H| than those considered 
in Fig. El Plot as in Fig. ^\ 



gether with 711 and correlation times for x\, x-i and x-z- 
An immediate obvious observation is that, in contrast to 
the two previously considered cases of less synchronous 
subsystems, here the feedback can make synchroniza- 
tion perfect with 71,1=1, and can maintain it like this 
for a substantial range of re[0.25;2] (Fig. H7Ta)). The 
fact that the two subsystems are very synchronous from 
the beginning is also supported by very similar values of 
the correlation times of both systems' realizations and of 
their sum at t=0 (Fig. [1711)1 1. 

As r is slighly increased from zero, as in the two previ- 
ous examples, both (Ti) and (T 2 ) grow. But, as before, 
(Ti) grows a little faster than (T2). This can hardly be 
resolved in the plots, since (Ti) and (T2) are very close 
and hardly distinguishable. However, the difference be- 
tween them, and the disapperanace of this difference, is 
visible through the ISI ratio (Fig.nTTall. 

With this, t cor and 71,1 slightly grow, too. All quan- 
tities considered achieve their maxima at r«0.25. After 
that, as r increases, the individual ISIs (Ti) and (T2) 
grow simultaneously and remain equal, so that their ra- 
tio and synchronization index 71.1 stay equal to 1 with 
high accuracy in the range re [0.25; 2]. 

However, surprisingly, while the ISI ratio and 71,1 are 
equal to 1, i.e., the subsystems maintain the same level 
of perfect synchrony, all three correlation times decrease 
with t. This means that while the two subsystems fire 
simultaneously, these firings occur less regularly. Thus, 
the feedback here can introduce disorder into the system 
without destroying its perfect synchronization. 
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FIG. 15: Timescales, coherence and synchronization index of 
noise-induced oscillations in two coupled FitzHugh-Nagumo 
systems Eqs. J7J and depending on the time delay r at 
K = 1.5, £>i=0.6 and C=0.1 (see Fig. [T3] for reference). 
Symbols as in Fig. 1111 



Then, as r continues to increase beyond the value of 
2, as in the previous examples, the second subsystem 
demonstrates a noticeable maximum of its ISI (T2). Al- 
though unlike in the two other examples, here (Ti) con- 
tinues to decrease, the ISI ratio and 71,1 exhibit a sharp 
minimum, and then grow again. 

At t increases beyond 8, the ISI ratio and 71,1 become 
less and less dependent on r, asymptotically tending to 
some values that are only slighly lower than without the 
feedback. On the contrary, t cor continues to change non- 
monotonically with r, never becoming less than without 
the feedback. Since the system is in the state of a strong 
synchronization throughout the changes in r, the changes 
in all three curves t cor occur synchronously. 

Thus, the feedback can make both local and global 
dynamics of the system more coherent, and at the same 
time weaken synchronization. 



IV. SUMMARY AND CONCLUSIONS 

We have considered a model describing two coupled ex- 
citable neurons, in the form of two mutually coupled non- 
identical excitable FitzHugh-Nagumo systems, subject to 
independent sources of noise with different strengths. In 
order to assess the effect of time-delayed feedback control 
upon the coupled system, we have analyzed the following 
characteristics: the timescales of the individual systems 
quantified as mean interspike intervals (ISI); the ISI ratio 
as a measure of frequency synchronization; the coherence 
quantified by the correlation time of the individual sub- 
systems' realizations and of their sum; and the index of 
1:1 phase synchronization between the subsystems. 
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FIG. 16: (color online) Effect of delayed feedback on fre- 
quency and phase synchronization betwen the two subsystems 
at Di=0.15 and C—0.2, which are closer to the 1:1 synchro- 
nization tongue shown in Fig. |S| than those considered in 
Fig. El Plot as in Fig. ^ 




FIG. 17: Timescales, coherence and synchronization index of 
noise-induced oscillations in two coupled FitzHugh-Nagumo 
systems Eqs. J7J and J5J depending on the time delay r at 
K=l, Di=0.15 and C=0.2 (see Fig. EOfor reference). Sym- 
bols as in Fig. [Til 



The coupled system without control displays a 1:1 
synchronization tongue in the (Di,C) parameter plane, 
given by the noise strength D\ in the first subsystem and 
the coupling strength C. Interestingly, frequency and 
phase synchronization occurred in the same area of the 
parameter plane. Two mechanisms for synchronization 
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were identified: phase (frequency) locking, and suppres- 
sion of natural dynamics, respectively. 

Next, the first of the two interacting subsystems was 
subjected to the local delayed feedback with the aim to 
manipulate the global dynamics of the system of inter- 
acting oscillators. The feedback force was constructed 
as a difference between the current state of the system 
and its state some r time units before, multiplied by a 
positive constant K. 

The delayed feedback was applied to the system in 
three states of synchrony: moderately synchronized, 
weakly synchronized, and strongly synchronized. In all 
three cases, 1:1 synchronisation could be either improved 
or weakened, depending upon the choice of r and K. 
Like the correlation times, the synchronisation index is 
modulated nonmonotonically as a function of the delay 
time r, indicating that there is resonance-like behavior 
for certain values of r. Perfect synchronisation can only 
be achieved if the uncontrolled state is already sufficiently 
synchronized. 

The mechanism behind the reported action of the de- 
layed feedback is as follows. As it was shown earlier 
pa. Izil ] , the feedback applied to a single excitable sys- 
tem is able to change the timescales and coherence of 
noise-induced oscillations. When the system subjected 
to the feedback is coupled to another system, the shift 
of the timescale of the former will lead to a proportional 
shift of the timescale of the latter. The exact magnitude 
of the shift in the second subsystem will depend on the 
closeness of the two subsystems to the state of synchro- 
nization. Only if the two subsystems are sufficiently 1:1 
synchronized from the beginning, the shift in the second 
system can be expected to match the shift in the first 
system. 

Interestingly, the above mechanism does not always 
work in the system considered. Namely, for some ranges 
of time delay r, the change in r does not cause any no- 
ticeable change in the system to which the feedback is 
applied. However, it does change the properties of os- 
cillations in the system that is coupled to it, albeit that 
does not experience the influence of the feedback directly. 

An important observation is that the delay-induced in- 
crease of coherence of the global dynamics is most fre- 
quently accompanied by the growth of the degree of syn- 
chronization. However, a high synchonization index does 
not always mean high coherence: delayed feedback can 



induce, or make stronger, the synchronization between 
the two subsystems, but the state of each subsystem, 
and their global dynamics, can become more disordered 
at the same time. The converse is also true. 

It is remarkable that delayed feedback control can in- 
fluence global characteristics of the two coupled neurons 
although the control is only applied locally to a subsys- 
tem. We were able to enhance or destroy the regularity 
of oscillations and the stochastic synchronization of the 
two neurons by choosing appropriate control parameters, 
in particular a suitable delay time. 

We consider these findings as important for the under- 
standing of coupled nonlinear systems and see possible 
applications especially in neuroscience. In fact, exper- 
imental studies of two coupled neurons from the stom- 
atogastric ganglion of a lobster j29j, and from a leech 
30] have reported various degrees of synchrony of excita- 
tory postsynaptic potentials. As stochastic sources of the 
spontaneous random firing of neurons, noise due to the 
conducting ion channels, synaptic noise, and noise result- 
ing from the coupling to a large number of other neurons 
emitting signals, have been identified j3^- Also it was 
demonstrated experimentally [|| that spatially and tem- 
porally coherent Ca 2+ waves, mediated by network noise, 
may play an important role in generating correlated neu- 
ral activity. By applying delayed feedback control to real 
neural systems one should be able to influence neural 
synchrony. First results of applying time-delayed neuro- 
feedback from realtime MEG signals to humans via visual 
stimulation in order to suppress the alpha rhythm, which 
is observed due to strongly synchronized neural popula- 
tions in the visual cortex in the brain, look promising 
[3^|. Further work should focus on more sophisticated 
models and on coupling more than two neurons. 
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